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Abstract 

t— I . 

. In this paper, we develop new optional stopping theorems for scenarios where the stopping rules 

are defined by bounded continuity regions. Moreover, we establish a wide variety of inequalities on the 
supremums and infimums of functions of stochastic processes over the whole range of time indexes. 

Or 

■ 1 Introduction 
+-> • 

d- 

Martingale theory has been developed as a powerful tool for investigating stochastic processes. One of the 
'— most important results of martingale theory are Doob's optional stopping theorem [5] and its variations. 

These optional stopping theorems are relied on the assumptions such as uniform integrability or integrable 
stopping times. However, in many applications, the relevant stochastic process is not uniformly integrable 
and the expectation of the stopping time is not necessarily finite. Motivated by this situation, in this 
|- — . paper, we shall develop new optional stopping theorems for scenarios where the uniform integrability of 

C*~) \ the stochastic process or the integrability of the stoping time are not guaranteed, while the continuity 

■ region associated with the stopping rule is bounded. Based on the new optional stopping theorems, we 
have established general maximal inequalities, which accommodate some classical inequalities such as, 
Bernstein's inequality [3], Chernoff bounds [3] [5], Bennett's inequality [2J, Hocffding-Azuma inequality 
[U [9] as special cases. 

This paper is organized as follows. In Section 2, we present new optional stopping theorems. In Section 
3, we propose new maximal inequalities. Section 3 is the conclusion. All proofs are given in the Appendices. 
The main results of this paper have appeared in [7] . 

Throughout this paper, we shall use the following notations. Let R denote the set of real numbers. Let 
R + denote the set of non-negative real numbers. Let Z + denote the set of non-negative integers. Let N 
denote the set of positive integers. Let (A t ) tS T denote a stochastic process, where T C R+ is the set of time 
values. Specially, (A t ) tS T is a continuous-time stochastic process if T = K+; and (X t ) te j is a discrete-time 
stochastic process if T = Z + . We assume that all stochastic processes are defined in probability space 
(i7,J^,Pr). We also use P to denote the probability measure Pr. For t £ T, let i^t denote the sub-cr- 
algcbra generated by the collection of random variables {X T : < r < t, t £ T}. The collection (^t)teT 
of sub-cr-algebras of & is called the natural filtration of j?. Let U A V £>" denote the maximum of A and 
B. Let "A A B" denote the minimum of A and B. The other notations will be made clear as we proceed. 



CN 



CN 



*The author had been previously working with Louisiana State University at Baton Rouge, LA 70803, USA, and is 
now with Department of Electrical Engineering, Southern University and A&M College, Baton Rouge, LA 70813, USA; 
Email: chcnxinjia@gmail.com. The main results of this paper have appeared in Proceedings of SPIE Conferences, Baltimore, 
Maryland, April 24-27, 2012. 



1 



2 Optional Stopping Theorems 



In this section, wc shall first develop some new optional stopping theorems on stochastic processes. Consider 
a stochastic process (X t ) t! z R + defined in the probability space (O, J^",Pr). Let r be a stopping time taking 
values in R + U {oo}. Define 

X-r = lim X-rAt 

t— f oo 

if the limit exists. Clearly, for we!!, 

v , x \X T{u) {u) if t{u) < oo; 

I limt-^oo X t (w) if t(oj) = oo and the limit exists. 

Let Ti and r 2 be two stopping times. Since the stopping times can be 00, we shall define the notion of 
Ti < t 2 as follows: 

{ti<t 2 } = {uj G n : ti(w) < t 2 (w), Ti(w) G K+, t 2 (w) G K+} 

U{cj G : Ti(w) G K + , T 2 (o;) = 00} U{wgO:ti(w) = 00, t 2 (w) = 00}. 

Clearly, a discrete-time process (^fc)fcez+ can be viewed as a right-continuous process (X t ) t £M+ with 
= Xfc for t G [fc,fc + 1), fc G Z + . Therefore, we shall consider the optional stopping problems in the 
general setting of continuous-time processes. However, in order to develop new optional stopping theorems 
for continuous-time processes, we first need to establish discrete-time optional stopping theorems and then 
generalize them to continuous-time processes. For a discrete-time process, we have the following general 
results. 

Theorem 1 Let ^fc)fcez+ be a discrete-time super-martingale. Let T\ and r 2 be two stopping times 
such that T\ < t 2 almost surely and that there exists a constant C so that {r 2 > k) C {|Xfe| < C} for all 
k G Z + . Assume that 

X T2 exist and E[|X X2 1] is finite. (1) 

Then, E[X T2 | ^ Tl \ < X Tl and ~E\X T2 \ < E[X Tl ] almost surely, with equality if (X^, J^fc)fc e z+ * s a 
martingale. Specially, the assumption OP is satisfied and the conclusion follows in the following cases: 

(i) {Xk, ^k)kez+ * s a super-martingale such that there exists a constant A so that \X^+\ — X^\ < A 
almost surely for all k G Z + . 

(ii) (Xk, ^k)k£Z+ * s a non-negative super-martingale. 

See Appendix [5] for a proof. 

In particular, as an immediate application of Theorem [1] we have the following result. 

Corollary 1 Let {Xk)kez+ be a discrete-time stochastic process such that Xq, X n — X n —\, n = 1,2, ■■ • 
are independent random variables with zero means and that E[\Xq\] < 00, sup n>0 |X„ — X„_i| < 00 almost 
surely. Let T\ and t 2 be two stopping times such that T\ < t 2 almost surely and that there exists a constant 
C so that {r 2 > n} C {\X n \ < C} for all n>0. Then, E[X T2 \ & Tl ] = X T[ and E[X T2 ] = E[X Tl ] almost 
surely. 

To investigate optional stopping problems for continuous-time processes, throughout the remainder 
of this paper, we shall define two collections of sets of real numbers, denoted by t G R + } and 

{T> t , t G K + }, such that the following requirements are satisfied: 

(i) @t C V t for all t G R+ . 

(ii) There exists a positive constant C such that T> t C [— C, C] for all t G K + . 
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(iii) For any right-continuous function g(t) : M + M> M, 



lim inf {t G §„ : g 



lim inf {t 



(*) £ ^} 

(*) i vt} 



inf{t G K+ : g(t) £ 3>t}, 
inf{i G R + : #(t) ^ £><}, 



where S„ = {/c2~™ : fc G Z + } for neN. Note that the infimums can be 00. 

Clearly, if a stopping time t is defined such that {t > t] implies {Xt G T>t}, then the region of (Xt,t) 
for continuing observing (X t ) t6R + is bounded. In this sense, a stopping rule with such a stopping time is 
called a stopping rule with bounded continuity region. 

In many areas of engineering and sciences, it is a frequent problem to investigate a stochastic process 
with bounded rate of variation. For this purpose, the following result is useful. 

Theorem 2 Let (Xt, i^t)teR+ t> e a right- continuous super-martingale such that there exist constants 5 and 
A > so that \X t ' — X t \ < A almost surely provided that \t' — 1\ < S. Let t\ — inf{f G M + : X t £ @t} and 
T2 = inf{< G M + : X t £ T>t}- Then, E[X T2 \ & ri ] < X Tl and E[X T2 \ < E[X Tl ] almost surely, with equality 
if (X t , .^t)t £ R+ is a martingale. 

See Appendix [B] for a proof. 

Theorem 3 Let (X t , J£" t ) t6R + be a right- continuous, non-negative super-martingale. Let T\ = inf{i G 
M+ : X t (f. and r 2 = inf{t E R+ : X t £ £>*}. Then, E[X T2 \ < X Tl and E[X T2 ] < E[X Tl ] almost 

surely, with equality if (Xt, ^t)teR+ * s a martingale. 

See Appendix [C] for a proof. 

It should be noted that Theorem [3] can be readily generalized to a right-continuous super-martingale 
which is bounded from below by a constant. Making use of Theorem [31 we have established Corollary [5] as 
follows. 

Corollary 2 LetVt be a right- continuous function oft > 0. Let (X t )t£R+ be a right- continuous stochastic 
process such that 



almost surely for arbitrary t > r > and s G (—a, &), where a and b are positive numbers or infinity, and 
<p(s) is a function of s G (—a, 6). Define Y t = exp(sX t — tp(s)Vt) f or s € ( — a, £ef Ti = inf{£ G R + : 
F t £ t } and r 2 = inf{i G R+ : F t g P t }. TTien, E[F T2 | & T1 ] < Y Tl and E[Y T2 ) < E[Y Tl ] almost surely, 
with equality if holds with equality almost surely for arbitrary t > t > and s G (—a, 6). 

3 Maximal Inequalities 

By virtue of the above optional stopping theorems, we shall establish some general maximal inequalities. 
With regard to a uniformly integrablc (UI) martingale process, we have discovered the following fact. 

Theorem 4 If (X t , J^t)t£R+ * s a right- continuous uniformly integrable martingale which converges almost 
surely to a constant c, then X t is equal to the constant c for all t > almost surely. 

See Appendix [D] for a proof. 

Theorem [4] implies that a right-continuous non-constant UI martingale never converges to a constant. 
For a super-martingale converging to a constant, we have the following results. 



E[exp(sA- )] < exp(^(s)V ) 



E[exp(s(A t - X T )) I & T ] < exp(^(s)(Vt - V T )) 



(2) 
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Theorem 5 Let {X tl ^t)tes.+ be a right- continuous, non-negative super-martingale which converges almost 

7-c 



surely to a constant c. Then, Pr {sup t>0 Xt > 7} < E ^j e c for any 7 > c. Specially, Pr {sup t>0 X t > 7} 
is equal to E ^^~ c and 1 in accordance with 7 > E[Xo] and 7 < E[.Xo] under additional assumption that 
{X t , ^t)teVi + * s a continuous martingale. 

See Appendix [E] for a proof. 

By virtue of Corollary [2] and Markov's inequality, the following Corollary [3] can be established. 

Corollary 3 Let Vt be a right- continuous function oft>0. Let (X t ) t£R + be a right- continuous stochastic 
process such that E[cxp(sXo)] < exp(y>(s)Vo) and K[cxp(s(X t — X T )) \ J?,-] < cxp(<ys(s)(Vt — V r )) almost 
surely for arbitrary t > r > and s G (—a, 6), where a and b are positive numbers or infinity, and ip(s) is 
a function of s G (—a, b). Define Y t = exp(sA t — ip(s)Vt) for s G (—a, b). Then, Pr |sup t>0 Y t > 7} < - 
for 7 > 0. 

As a direct consequence of Theorem [51 we have shown the following Corollary @] 

Corollary 4 LetVt be a non-negative, continuous function oft>0 such that the limit inferior o/V„+i— V n 
with respect to n € N is positive. Let (X t ) teR + be a continuous stochastic process such that E[exp(sAo)] = 
cxp((^(s)Vo) and E[exp(s(X f — X T )) \ & T ] = exp(<£>(s)(V* — V T )) almost surely for arbitrary t > r > and 
s G (—a, 6), where a and b are positive numbers or infinity, and <p(s) is a function of s G (—a, 6). Define 
Y t = exp(sX t - tp(s)Vt) forse (-a, 0) U (0, b). Then, Pr{sup t > T t > 7} = ± for 1 > 1. 

See Appendix [FJ for a proof. 

Making use of Corollary |3l we have developed the following results concerning stochastic processes. 

Theorem 6 Let Vt be a non-negative, right- continuous function of t G [0, 00). Let (X t )t^m+ be a right- 
continuous stochastic process such that E[cxp(s(X t < — X t )) \ ,^t\ < exp((Vf — Vt)iys(s)) almost surely for 
arbitrary t' > t > and s G (—a, 6) , where a and b are positive numbers or infinity, and <p(s) is a non- 
negative function of s G (—a, 6). Let r > 0, 7 > 0, r\ > 0. Define sd = {s G (0,a) : <p(—s) < 7s} and 
:i§ = {s G (0, 6) : ip(s) < 7s}. Then, 



Pr 
Pr 
Pr 
Pr 
Pr 
Pr 
Pr 
Pr 



inf 

t >o 



sup 

t>0 



X t - X + 7 V T + ^-^(V* - Vr) 
s 

X t -Xo- 7 V T -^(V ( -V T ) 



< 0| < [exp(y>(-s) -7s)] Vt VsG(0,a), 
> 0} < [exp(vp(s) -7s)] Vt VsG(0,6), 



inf [X t - X + 7(V T V Vt)] < } < inf [exp O(-s) - 7s 



s6(0,a) 



sup[X t - X - 7(V T V V t )l > ol < inf [exp (ip(s) - 7s)] Vt and 
t>o J se(o,b) 



moreover, 



inf (X t - X + v + 7Vt) < f < inf e 



sup (X t - X - 7) - 7 Vt) > ^ < inf e - " 



inf [X t - Xo + V + 7 (V T V Vt)] < } < inf e~ ns [exp - 7 s 



sup [X t - X - r] - 7 (V T V V t )] > } < inf e^ s [exp (<p(s) - 7s)] 



(3) 
(4) 
(5) 
(6) 
(7) 
(8) 
(0) 
(10) 



provided that si and £$ are nonempty respectively. Ln particular, under the above assumptions on X t , Vt 
and <p{s), the following statements hold true: 
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(I): If tp(s) is a continuous function smaller than 7 |s| at a neighborhood of 0, then 

Pr{inf[X i -Xo + 7 Vr + «(7)(V t -V T )]<0}< inf [expfo>(-«) - 7 s)] Vt , (11) 

i>0 s£(Q,a) 

Pr{sup[Xt-Xo- 7 V T -/?(7)(Vt-V r )]>0}< inf [exp(^(s) - 7 s)] Vt , (12) 
t>o se(o,t) 

where a( 7 ) and /3( 7 ) are functions of j defined as follows: a( 7 ) is egwaZ io J/ ' i/inf s£ (o. a ) [f(~ s ) ~ 7 s ] 
is attained at s* £ (0,a) and otherwise equal to lim s f a y ^ s ^ ; /3( 7 ) is eguaZ to s t - i/inf se (o,6) [</?( s ) — 7 s ] 
is attained at s* £ (0, 6) and otherwise equal to lim s -|-f, Moreover, < a( 7 ) < 7 and < /3( 7 ) < 7. 
(7J): J/ is monotonically increasing with respect to \s\ > 0, t/ien 

Pr{infpf t -X + n + 7 (V T VV f )]<0}< inf e" 7S [exp( V 3(-s) - 7 s)] Vt (13) 

£>0 s£(0,o*) 

and 

Pr{sup[X t - Xo - n - 7 (V r V Vt)] > 0} < inf e -" s [exp (<p(s) - 7 s)] v \ (14) 

t>0 s6(0,b*) 

where a* and b* are defined as follows: a* is equal to a i/lim s -|- a ^ < 7 and otherwise equal to s £ (0, a) 
smc/i i/iai = 7; 6* is egwa/ £0 b i/lira s -|-& < 7 and otherwise equal to s £ (0, &) smc/i £/ia£ — ^. 

See Appendix [G] for a proof. 

An important application of Theorem [5] is illustrated as follows. Let Y be a random variable with mean 
/Lt. Define Ao = and A„ = XaLiO'i — A 4 ) f° r where Yi, Y2, • • • are i.i.d. samples of Y\ Define a 

right-continuous stochastic process (At) t( =R+ such that At = A„ for t £ [n, n + 1), n = 0, 1, 2, ■ ■ ■ . Define 
a right-continuous function Vt of t £ K + such that Vt = n for i G [n, n + 1), n = 0, 1, 2, • • • . If there is 
a convex function tp(s) such that InE [exp (s(Y — /j,))] < ip(s) for s £ (—a, b) and that </j(0) = 0, then we 
can apply Theorem [6] to develop maximal inequalities for (A t ) tg R+, which immediately lead to maximal 
inequalities for (A„)„ g N- The function </c(s) of the desired properties can be found for some particular 
cases as follows: 

(i) If the moment generating function of Y exists, then <p(s) can be taken as InE [exp (sY)] — fis. 

(ii) If Y is a random variable such that E[Y] = 0, E[Y" 2 ] = a 2 and Y < b, then by Bennett's inequality [2], 
the function <p(s) can be taken as ln ^^a exp(— ^-s) + -gf^p. exp(6s)]. 

(iii) If Y is a random variable bounded in interval [0, 1] almost surely, then by Hoeffding's inequality [3], 
the function ip(s) can be taken as ln(l — fj, + /ie s ) — /is. 

(iv) If Y is a random variable uniformly distributed over [—5, then we can show that E[e sF ] < exp(fj) 
for all real number s. Hence, the function ip(s) can be taken as See Appendix [Hi for the development 
of the bound for the moment generating function E[e sy ]. 

Applying Corollary 2] to a continuous stochastic process, we have the following results. 

Theorem 7 Let Vt be a non-negative, continuous function of t £ [0, 00) such that the limit inferior of 
V n +i — V n with respect to n £ N is positive. Let (Af) tg R+ be a continuous stochastic process such that 
E[cxp(s(A t / — A t )) I J^t] = cxp((Vf — Vt)<p(s)) almost surely for arbitrary t' > t > and s £ (— a, b), 
where a and b are positive numbers or infinity, and ip(s) is a non-negative function of s £ (—a, b). Let 
t > 0, 7 > and 77 > 0. Then, Pr{inf t>0 [X t - X + 7K + ^=^-(V t - V T )] < 0} = [exp^-s) - 7 s)] v - for 
any s £ (0, a) and Pr{sup t>0 LY t - X - 7 V T - ^(Vt - V T )] > 0} = [exp(<^(s) - 7 s)] Vt /or any s £ (0, 6). In 
particular, under the above assumptions on A t , V t and <p{s), the following statements hold true: 

(I) : If there exists s* £ (0, a) such that <p(—s*) = 7 s*, then Pr {inf t>0 (X t - X + n + 7 Vt) < 0} = e~ vs * . 

(II) : If there exists s* £ (0, b) such that ip(s*) = 7 s*, then Pr {sup f>0 (X t - Xo - n - jVt) > 0} = e" 173 * . 

(III) : If <p(s) is a continuous function smaller than j\s\ at a neighborhood ofO, then Pr{inf t>0 [A t — Xo + 
7 V T + a( 7 )(Vt - Vt)] < 0} = w£, eM [exp(<p(-8) - 7 s)] Vt and Pr{su Pf>0 [X t - X - 7 V T - /3( 7 )(Vt - Vt)] > 



0} = inf s g( ,6) [exp(v(s) — "fs)] Vr , where a(j) and /3(j) are functions 0/7 defined as follows: a(~f) is equal 

to ^ f - if inf s g(o a ) [<p{—s) — 7s] is attained at s* G (0, a) and otherwise equal to lim s ^ a s ^ ; /3(7) is 

egwa/ io ^ */i n f.se(o.fc) [^(s) — 7 s ] * s attained at s* G (0, b) and otherwise equal to lim s ^b Moreover, 
< (1(7) < 7 and < £(7) < 7. 

Applying Theorem [5] to i.i.d random variables with common probability density (or mass) function in 
an exponential family, we have shown the following results, which generalize Chcrnoff bounds 0]. 

Corollary 5 Let Yx,Y%, ■ ■ ■ be i.i.d. random samples ofY which possesses a probability density (or mass) 
function fy(y;0) — w(y) exp(u(9)y — v{6)) such that ^p- = O ^P for 9 e 9. Define X n = YH=i ^ 
for n G N. Define ^#(z, 9) = cx P("( 9 ) z ~'"( e )) anc j q( z q m n \ = TOZ _|_ ( n _ m) v i z l~ v< f2 for z,6 G and 
m, n G N. Then, for all integer m > and rea/ number 7 > 0, 



Prisup [X„-nff-7(nVm)] > ol < Pr { sup [X„ - p(9 + 7, 9, m, n)] > ol < [.^((9 + 7, (9)] r 

[n>0 J [n>0 J 



(15) 

Pr <J inf [X n - nO + 7(71 V m)] < |> < Pr <j inf [Jf„ - p(6» - 7, 9, m, n)] < J> < - 7, 6>)] m , (16) 

[n>0 J ^n>0 J 

provided that 8 + 7 € O and (9 — 7 G respectively. 
See Appendix U for a proof. 

By virtue of Theorem^ we can generalize Hocffding-Azuma's inequality [TJ[!5] as follows. 

Corollary 6 Let (A^) tgR + be a right- continuous stochastic process. Assume that there exist a right- 
continuous function Vt and a stochastic process (5 / t)t 6 K+ such that for all t > 0, Yt is measurable in 
and that \X t — Y T \ < Vt — V T almost surely for arbitrary t > r > 0. For 7 > and r > such that 
V T > 0, the following statements hold true: 
(I) If (X t , J^t)i 6 R+ is a super-martingale, then 
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Pr ■{ sup 

t>o 



Xt — Xn 



> } < exp 



(II) If (X t , ^t)teR+ * s a sub-martingale, then 



Pr s inf 

t>0 



Xt — Xn 



(III) If {X t , ^t)tgR+ « martingale, then 



Pr ^ sup 



\X t -X \-^\ 1 



vv 



vv 



< } < exp 



7 

2V T 



7 

2V r 



> ^ < 2 exp --^ r 



2V T 



(17) 



(18) 



(19) 



See Appendix [J] for a proof. 

With the help of Theorem[6j we have generalized Bernstein's inequality [3], Bennett's inequality [2] and 
Chcrnoff bound [5] as follows. 



Corollary 7 Let (Xk, ^k)kez+ be a martingale satisfying Var(A„ | J?„_i) = f E[(A„ — K[X n \ ,^ n -i]) 2 \ 
a 2 n and X n - X n _ x < a n + b almost surely for n G N, where b > and a n are deterministic 
numbers. Define V n = X)"=i( cr f + a i) f or ^ S N. Then, 

1 V m 



Pr < sup 

ln>0 

Pr < sup 

(n>0 



X n - X - 7V: 

X n — Xo — — 
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1 + 



ln(l + 67) b 

Vn 



T (Vn - V m ) 



> )■ < 



ex Pl - 



7 (1 + 67) ln(l + 67) 



6-' 



V„ 



> } < exp 



2(V m + 67/3) 



(20) 
(21) 



G 



for all integer m > and real number 7 > 0. Specially, if b = 1 and a n = /or neN, i/ien 



Pr <^ sup 

Ln>0 



2 I V m 



> } < exp - 



7 

4V„ 



(22) 



/or a/Z integer m > and reaZ number 7 6 (0, £V m ). 



See Appendix |K] for a proof. 

Applying Theorem [6] to a Poisson process, we have obtained the following results. 

Corollary 8 Let X t be the number of arrivals in time interval [0,t] for a Poisson process with an arrival 
rate A > 0. Then, 



Pr •{ sup 

t>o 



Pr <! inf 

t>o 



X t - (A + i)r - 
X t - (A - 7 )r + 



7(*-t) 



ln(l + i) 

7(*~t) ' 



> 0^ < 



A 



Mi - i) 



< ^ < 



A + 7 



A-7 



A+7 



A-7 



/or any r > and 7 > 0. 

See Appendix |L] for a proof. 

4 Conclusion 

In this paper, we have developed some new optional stopping theorems on martingale processes which 
require no assumption of uniform integrability and integrablc stopping times. Making use of bounds of 
moment generating functions of increments of stochastic processes, we have established a wide class of 
maximal inequalities on stochastic processes, which includes classical results such as Chernoff bounds, 
Hoeffding-Azuma inequalities as special cases. 

A Proof of Theorem [I] 

Throughout the proof of the theorem, let A £ and B = A n {t\ = n} £ jF n . 



A.l Proof of Discrete-Time Optional Stopping Theorem under Assumption 

In this section of Appendix we shall show the discrete-time optional stopping theorem under assumption 
(flj. More formally, we want to prove the following result: 

Let (Xk, ^~k)k£Z+ oe a super-martingale. Let T\ and T2 be two stopping times such that T\ < T2 almost 
surely and that there exists a constant C so that \ti > k} C {|-Xfc| < C} for all k £ Z + . Assume that X T2 
exist and E[|A T2 |] is finite. Then, E[A T2 | ^ Tl ] < X Tl and E[A T2 ] < E[X Tl ] almost surely, with equality 
if (Xk, ^k)k£Z+ * s a martingale. 

The following result stated as Lemma [1] is due to Doob [8] , which can be found in many text books of 
probability theory. 



Lemma 1 For i > 



n, 



X n dF> / X T2 dF+ Xt d¥, 

n{-r 2 >n} JBn{fi<T 2 <i} J Bn{-r 2 >i} 



(23) 



with equality if X t is a martingale. 
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Lemma 2 Pr {lim^oo I Sn{n < 7 . 2 < i} = I Bn {n<-r 2 <oo} } = 1- 

Proof. To show this, consider two cases. In the case that u £ B n {n < t-2 < oo}, we have u ^ 
B n {n < t% < i} for all i > n and thus lBn{n<T 2 <oo} = = lirrij-^oo ^-Bn{n<T 2 <i}- I n the case that 
w£B(l{n<T2< oo}, we have Isn{n<T 2 <oo} = 1- Then, fBn{n<T 2 <i} = 1 for i > T2(oj), which implies 
that limi-j.oo I,en{?i<i- 2 <i} = 1- This proves the lemma. 

□ 



Lemma 3 Assume that E[|X X2 |] < oo. Then, 



lim / X T2 dP= X T2 

'" iK, iBn{ii<T 2 <i} J_Bn{Ti<-r 2 <oo} 



: / \X T2 \ dF < oo. 

'Bn{n<T 2 <oo} 



Proof. From the assumption that E[|X T , |] < oo, we have 

E [X X2 I B n{n<x 2 <oo}] < E [l-^ral Isn{ri<-r 2 <oo}] < E[|X T2 |] < OO. 

By virtue of Lcmma[2j we have that -Xi- 2 I.Bn{?i<i--><i} -^-r 2 I.Bn{n<i- 2 <oo} almost surely as i — > oo. Since 
\^T 2 ^-Bn{n<T 2 <i}\ — \Xt 2 \ lBn{ii<T,<cx)}: the lemma follows from the dominated convergence theorem. 

□ 



Lemma 4 



lim / Xi dl 

J B<i{t 2 >i} 



Bn{-r 2 =oo} 



X T2 dP < 



sn{-r 2 =cxD} 



\X T2 \ dF < oo. 



Proof. First, we shall show that 



lim / Xi dF = 0. 

t-K» /l3n{i<T2<00} 



(24) 



By the assumption that there exists a constant C so that {T2 > t} C {\X t \ < C} for any t > 0, we have 

J Bn{i<T 2 <oo} 



lim 

i— >-oo 



< lim / \Xi\ dl 

'- >KJ JBn{!<T 2 <oo} 



< lim / CdF< lim / C 

I Bn{i<T 2 <oo} i ^°°J{i<T2<oo} 



C lim Pr{i < r 2 < oo} = 0, 



which implies (|24|) . 

Next, we shall show that 



lim 



X t dF = / X T2 

Bn{x 2 =oo} J_Bn{-r 2 = oo} 



(25) 



By the assumption that there exists a constant C so that {t-2 > t} C {\X t \ < C} for any t > 0, we 
have |Xj I_Bn{-7- 2 =oo}l < C f° r a U i > n. By the definition of X To , we have that I_Bn{T 2 =oo} — ^ 
-^r 2 I_Bn{T 2 =oo} as i — > oo. Therefore, applying the bounded convergence theorem leads to (|25|) and the 
inequality / Bn{x2=oo} |Xr 2 | dP < oo. 



S 



Finally, combining (f!M)) and (|2~5j) gives 

lim / Xi dP = lim / 

<->•<» Jsn{x 2 >i} '^iflnl! 

This completes the proof of the lemma 



1"2 

" O0 - / Bn{r 2 >i} JBn{i<T 2 <oo( "°°JBn{T F oo} JSn{T- 2 = oo} 



□ 



Now we are in a position to prove the discrete-time optional stopping theorem under assumption ([T]). 
Since X T2 exits, it must be true that X Tl exists. It suffices to show that 

/ X T2 dP< X Tl dP 

J An{T 2 >Ti} J in{T 2 >Ti} 

for any A £ J~- ri . For this, in turn, it is sufficient to show that, for every n £ Z + U {oo}, 

I X T2 dP< I X T1 dP. 

JAn{T 2 >Ti}n{Ti=n} J Ac\{T 2 >T 1 }r\{T 1 =n} 

This inequality is clearly true for n = oo, because 

A n {t2 > Ti} n {t\ = n} = A n {ti = oo, T2 = 00} = in {ti = 00, T2 = 00, Xt 2 = X T1 } 
holds for n = 00. Recall Lemma [TJ we have that for i> n, 

X n dP> / X T2 dP+ X l dP, (26) 

Bn{T 2 >n) J Bn{n<T 2 <i} isn{T 2 >i) 

with equality if X t is a martingale. Taking limits on the right side of (|26j) and making use of Lemmas [3] 
and|H we have 

X n dP > lim / X T2 dP + lim f X, dP 

Bn{T 2 >n} J Bn{n<T 2 <i] isn{T 2 >.} 



X T2 dP + X T2 dP= X T2 dP, 

Bn{n<T 2 <oo} ^sn{T2=oo} JBn{T2>ll} 

with equality if (Xk, ^k)kez+ is a martingale. This completes the proof of the discrete-time optional 
stopping theorem under assumption ([1]). 

A. 2 Proof of Discrete-Time Optional Stopping Theorem for Super-martingale 
with Bounded Increment 

In this section of Appendix fXJ we shall show the discrete-time optional stopping theorem for super- 
martingale with bounded increment. More formally, we want to prove the following result: 

Let (Xk, ■-^ r k)k£Z+ be a super-martingale such that there exists a constant A so that \Xk+i — Xk\ < A 
almost surely for all k £ Z + . Let n and T2 be two stopping times such that T\ < T2 almost surely and 
that there exists a constant C so that {T2 > k} C < C} for all k £ Z + . Then, E[Xt- 2 | & Tl ] < X Tl 

and E[Xt 2 ] < ~E[X Tl ] almost surely, with equality if (Xk,^k)kez+ * s a martingale. 

For this purpose, it suffices to show that assumption ([l} is satisfied. This can be accomplished by 
proving the following lemma. 

Lemma 5 X TA k is a UI super-martingale. Moreover, X T exists and ¥\\X T \\ < 00. 
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Proof. For simplicity of notations, we denote J F XdP by ~E[X; F]. Let T > 0. Note that 

k 

E[|X TAfc |; |X xAfc |>T]=EpV Afe |; \X TAk \>T, r > k] + ^E[|X TAfc |; |X TAfe | > T, r = i] 

k 

= E[|X fe |; \X k \>T, r>k}+J2 E l\Xi\; \X T \>T, r = i] 

k 

= E[\X k \; \X k \>T, t>*]+E[|X |; > T, r = 0] + ^ E[|X|; \X T \ > T, i - 1< r = i] 

i=l 
k 

= E[|X fe |; |X fe |>T, T>fc]+E[|X |; |X | > T, r = 0] + ]T E[|X|; |Xj| > T, i - 1< r = i] 

i=l 

<E[|X fe |; T< |X fe | <C]+E[|X |; |X | > T] + ^E[|X|; |X,,| > T, \X t ^\ < C] 

i=l 
k 

<E[|X fe |; T< |X fe | <C]+E[|X |; |X | > T] + ^ E[|X|; |-X"<_i| + |X, — X,_i| > T, \Xi-x\<C\ 



for all k > 0. By the bounded increment assumption, there exists a positive constant A > such that 
Pi{\Xi - X t ^\ < A} = 1 for * > 1. Choose T > C + A, then E[|X xAfe |; |X TAfe | > T] < E[\X \; \X \ > T] 
for all k > 0. By the assumption that E[|Xo|] < °°j we have that there exists a sufficiently large T > C + A 
such that E[|X |; \X \ > T] < s. Hence, E[|X TAfc |; |X xAfc | > T] < e for all k > 0. This implies that X TAk 
is a UI super-martingale. 

Since X TAk is a UI super-martingale, we have sup fe E[|X,- A fc|] < oo. Moreover, X TAk converges as k — > oo 
and X T exists almost surely. By Fatou's lemma, E[|X,-|] = Efliminffc-^oo |X TA fc|] < liminffc^oo E[|X TA fc|] < 
sup fc E[|XT- Afe |] < oo. 

□ 



A. 3 Proof of Discrete-Time Optional Stopping Theorem for Non-negative 
Super- martingale 

In this section of Appendix [A] we shall show the discrete-time optional stopping theorem for non-negative 
super-martingale. More formally, we want to prove the following result: 

Let (X k ,^ k ) ke z+ be a non-negative super-martingale. Let T\ and T2 be two stopping times such that 
T\ < t-2 almost surely and that there exists a constant C so that {T2 > k} C {X k < C} for all k G Z + . 
Then, E[Xt- 2 \ ^ Tl ] < X T1 and ~E\X T2 \ < E[X Tl ] almost surely, with equality if (X^, j£fc) fcgZ + is a 
martingale. 

Since a non-negative super-martingale must converge, it follows that both X Tl and X T2 exist. As an 
immediate consequence of Lemma 31 we have the following result. 

Lemma 6 For any non-negative integer n, < lim^oo / Bn { T2>i } X.; dV = Jg n s T2=00 \ X T2 dP < oo. 

We are now in a position to prove the discrete-time optional stopping theorem for non-negative super- 
martingale. It suffices to show that 

/ X T2 dF < X T1 dV 

J A^{t 2 >t 1 } J An{-r 2 >T 1 } 
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for any A e J^" Tl . For this, in turn, it is sufficient to show that, for every n G Z + U {oo}, 



X T2 dP < 



X T1 dP. 



i An{T 2 >Ti}n{Ti=ii} J An{T 2 >-ri}n{Ti=n} 

This inequality is clearly true for n = oo, because 

A n {t2 > ri} n {ti = ?i} = A n {ti = oo, 1-2 = 00} = A n {ti = 00, T2 = 00, x T2 = x Tl } 

holds for n = oo. It remains to show, for n S Z + , 



A T2 dP < 



Bn{T 2 >n} 



X„ cflP. 



Bn{T 2 >n} 



As a consequence of Lemma [2l 



X T2 dP = E 



Bn{n<T 2 <(X)} 



liminf XT- 2 lBn{n<x 2 <i} 



Note that 



3 



liminf X T2 I B n{n<T- 2 <i} < ^SlH^ E[^"-r 2 lBn{n<T 2 <i}] 

A T „ cflf 



lim inf 

i— f 00 



< lim inf 



Bn{n<T 2 <i} 

X n dP - 

Sn{x 2 >n} 

!"„ g?P — lim sup 



Xi dP 



Bn{T 2 >n) 



X., 



Bn{T 2 >n) 



n{-r 2 >«} 

Bn{T 2 >i} 
X^ dl 



X; 



Bn{-T2=oa} 



(27) 



(28) 



(29) 



(30) 



(31) 



where (f2"9"| follows from Fatou's lemma, (f3T))) follows from Lemma [TJ and (f3"Tj) follows from Lemma [BJ 
By the assumption that (Xk, ^k)k^z+ ' m a super-martingale, we have that X n is integrable and thus 
< Js n / T2 > n T. X n dP < 00. From Lemma[BI we know that < /g n r T2=00 i X T2 dP < oo. It follows from 
TJ that < E [liminf j^oo -XT 2 lBn{«<T2<»}] < oo. Combing (gSJ) and (JHTJ) yields 



< 



X X2 dP < 



Bn{n<T 2 <oo} 



X n dP - 



Bn{T 2 >n} 



X T2 dP < oo 



Bn{-r 2 = oo} 



or equivalently, 
< 



X T2 



n{-r 2 >n} 



A T2 dP < 



sn{x 2 =oo} 



X„ dP - 



Bn{T 2 >n} 



X T2 dP < oo, 



n{-r 2 — oo} 



which implies (f2"T|) . So, we have established that E[X T , | <P Tl ] < A Tl and E[A T ,] < E[X Tl ] for the case 
that (Xk, ^fe)feez+ is a super-martingale. It follows that < E[X T ,] < E[_X"o] < oo. Applying Theorcm[T] 
we have E[Xr 2 | & Tl ] = X Tl and E[X,- 2 ] = E[X Xl ] for the case that (Xk, ^k)kez+ is a martingale. Thus, 
we have established the discrete-time optional stopping theorem for non-negative super-martingale. 
So, we have completed the proof of Theorem Q] 
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B Proof of Theorem [2] 



Recall the assumption that there exist constants 5 and A such that \X t ' — X t \ < A almost surely provided 
that \t' - 1\ < 8. For such S, define v = \\og 2 i] and T„ = {k2-( n+ ^ : k G Z+} for n G N. Define 

p n = mi{t G T„ : X t i 9t], Q n = ud{t G T„ : X* £ X> t }, 
X p = lim X p At) X„ = lim X e At , 

t€T n t€T n 



for n € N. Define 



' A 



for fc G Z + and n G N. Then, the following statements are true. 

(a) : For n G N, (Y^ , T k ) keZ + IS a discrete-time super-martingale. 

(b) : For k G Z + and n G N, the inequality tk+i. n — ife.n < 6 holds and consequently, \Y£ +1 — Y^l < Z\ 
almost surely. 

(c) : S n < T n and {T n > k} C > C*} for n G N. 



Define 



y 5 "„ = lim y£ Afc , y£ = lim y^ Afc 

k— J-oo fc— J-oo 



for n G N. Note that 5„ and T n are stopping times non-increasing with respect to n G N. To complete the 
proof of the theorem, we need the following results. 

Lemma 7 (I) p n and g n are stopping times non-increasing with respect to n G N. 

(II) p n > Ti, £>„ > t 2 and p n < Q n for all n G N. 

(III) limn^oo p n = n and lim^^ g„ = T 2 . 

(TVy For aZZ n G N, -X" Pn and exist almost surely. 

(V) X Tl and X To exist almost surely. 

(VI) As n tends to infinity, X Pn and X Qn converge to X T1 and X T2 respectively and almost surely. 

Proof. Statements (I) - (III) are obviously true. We shall show statements (IV), (V) and (VI). 

Proof of Statement (IV) : Consider the existence of X Pn for n G N. From Lemma[5]and statements (a), (b) 
and (c) appeared before Lemma[7l we know that for every n G N, (Yg Ak , F k )fe £ z+ is a discrete-time 
UI martingale and it follows that, almost surely, lim^oo Yg Afc exists and is finite. By the definitions 
of T„, p nl S„ and {y fe ™}, we have that limt-t-oc X PnM = limfe^oo Yg nAk almost surely for all n G N. 
Since X„ is defined as limt^oo X„ At , it follows that X„ exists almost surely for all n G N. In a 
similar manner, the existence of X e can be established for n G N. 

Proof of Statement (V) : Consider the existence of X Tl . Let n G N be fixed and let ui G f2 with t\{uj) = oo. 
From the proof of Statement (IV), we know that the limit limt-^oo X PnM exists. Since p n > Ti, wc 
have p n (oS) = oo. This implies that limt^oo X t (u)) exists. We claim that the limit limt-^oo X t (u)) 
exists and is equal to limt-n» X t (uj). Suppose, to get a contradiction, that lim^oo _Xf (ui) does not 
exist. Then, there exist an e > and a sequence {ti}°l 1 with t± < t% < ts < ■ ■ ■ and ti — > oo as 
i —> oo, such that \X ti — c\ > e for i > 1, where c denotes limt^oo X t (u>). Define W„ = T n U 
That is, the sequence {U}^ 1 is added to T„ to form a new sequence W„. Define p n = inf{t G W„ : 
Xt $t}- By the same argument as that for proving the existence of limt^oo X Pnfxtl we can show 
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that linit->oc Xp, nAt exists almost surely. Observing that fi n > T\, we have A*„(w) = oo. Therefore, 
limt^oc XAui) exists. Since T„ C W„, it must be true that limt^oo XAuj) = c. Since C W„. 

tew„ tew„ t— 1 

it follows that lim^oo X ti (w) exists and is equal to c. This contradicts to the assumption that 
\Xtt — c\ > s for i > 1. Thus, we have established the claim that limt_>oo X(w) exists and is equal 
to limt->oo X t {uj) for w G S. with t"i(oj) = oo. Since X Tl is defined as limt_>oo X Tl At , it follows that 
X Tl exists almost surely. In a similar manner, the existence of X T2 can be established. 

Proof of Statement (IV) : Consider the convergence of (X Pj J„ 6 n- Recall the established fact that X p = 
limt^oo X PnM exists almost surely for all n G N. Let u> G f2 with t\{uj) = oo. Since p n > T\, we have 
p n (ui) = oo for all n G N. It follows that X Pn (uj) = limt^oo X t (uj) = lim t _>.oo X t (uj) for all n E N. 
Therefore, 

lim X p (lj) = lim X t (w) for uj G f2 with Ti(u;) = oo. (32) 

Now let uj G 51 with t\{uj) < oo. Since lim.n_5.00 P„ = T ii we have that p n (uj) < 00 for sufficiently large 
n G N. This implies that X p?i (u;) = X p ^^(uj) for sufficiently large n G N. Since lim rl „ ) . 00 p n (uj) = 
7i(w) and (X t ) t £T!t+ is a right-continuous process, we have that 

lim X p (uj) = X T ( u \(uj) for uj G f2 with ti(w) < 00. (33) 

Making use of (|3"2"j) . (|3"3")) and the definition of X T1 , we have that X Pn converges to X Tl almost surely 
Similarly, we can show that X Bn converges to X T2 almost surely. 

□ 

Lemma 8 As n tends to infinity, X Pn and X Bn converge to X Tl and X Tr> respectively in L . 

Proof. Let :neNU {°°}} be a collection of sub-a-algebras of & with $^_„ = jF Pn for n G N and 

^-00 = flfceN^-fc- Define __.„ = X Pn for n G N. Then, Z_„ = Yg n for n G N. According to TheoremHJ we 
have that E[Y£ | < F™^ almost surely for n G N. Since = X Pn and J 7 ^ = _^ Pn for n G N, we 

have that ¥,[X Pn | ^ P ,J < -^p„ + i almost surely for n G N. This implies that E[Z_ n | _?_(„+!)] < Z_( n+1 ) 
almost surely. Hence, {Z- n , n G N} is a supermartingale relative to {^- n : w G NU {00}} in the context of 
Levy-Doob Downward Theorem (see, e.g., [TUJ page 148-149]). Moreover, from Theorem [TJ we have that 
E[F"J < E[y , n ] almost surely for n G N. Since Y£ = X Pn and Y ,n = X Q , we have E[X P J < E[X ] < 00, 
which implies that sup n6N E[Z_„] = sup IlgN E[X p J < 00. Therefore, it follows from Levy-Doob Downward 
Theorem that {Z_ n , n G N} is uniformly integrable and that the limit .--oo = lim„_s.oo Z-„ exists almost 
surely and E[|Z_oo|] < 00. From Lemma[71 we know that Z_oo = X ri . Since {Z- ni n G N} is uniformly 
integrable and converges to X Tl almost surely, it follows that X Pn = Z- n — > X Tl in L . Similarly, we have 
that X Pn — > X T2 in L l . 

□ 

We are now in a position to prove the theorem. We follow the classical argument for extending the 
optional stopping theorem from discrete UI martingale to continuous-time UI martingale. According to 
Theorem [2 we have E[Y^ \ JgJ < K? almost surely for n G N. Since Y£ n = X Pn , Y^\ = X Qn and 
IFg = , we have 

E[X 0n I _r p J < X Pn (34) 
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almost surely for n £ N. Since t\ < p n , it holds that C j^" p . It follows from and the tower 
property that 

E[* e „ I ^rj = E[E[X e „ | jT p J | J^J < E[X Pn | JT X1 ] (35) 

almost surely. Let S £ ,^ T1 . It follows from (J3SJ) that X Sn dP < J„ X Pn dP. Invoking Lemma [5J we have 
X Pn — > X Tl in L 1 and consequently, 

/ X Pn dP - I X Tl dP < I \X Pn - X Tl \ dP < E[\X Pn - X T1 \] -> 
Js n Js Js 

as n — > 0. This implies that j g X Pn dV — > J g X Tl dP as n — > 0. Similarly, J g X Qn dP — > J g X T2 dV as n -> 0. 
Therefore, X^dP = lim„_ ) . o0 / # X en dP < lim, woo J g X Pri dP = J g X Tl dP. Since the argument holds for 
arbitrary § £ .j£ Tl , the proof of the theorem is thus completed. 



C Proof of Theorem [3] 

Since ^t)t&s.+ is a nonnegative, right-continuous supermartingalc, the limit lim^oo X t exists almost 
surely. As a consequence of this fact and the definition that X T . = limt^oo X TiAt , i = 1,2, it must be true 
that both X Tl and X T2 exist almost surely. For neN, define 

p n = iirf{t G S„ : X t i @ t ], Q n = inf{t g S„ : X- £ £> t }, 
X Pre = lim X PnAt , X Bn = lim X QnAtl 

By the same argument as that for the existence of X Tl and X T2 , we have that X Pn and X p?i exist almost 
surely for all n £ N. Define 

t k , n = k2-», Y£=X tktn , ?l = &t k , n 

for k £ 7L + and n £ N. Then, the following statements are true: 

(a) : For n £ N, (Y k n , J r ^ i ) fegZ + is a discrete-time non-negative super-martingale. 

(b) : S n < T n and {T„ > k} C > C} for neN. 

Define 

F£ = lim Yl Ak , Y% = lim Y^ k 

for n £ N. Note that 5„ and T n are stopping times non-increasing with respect to n £ N". To complete the 
proof of the theorem, we need to use the following results. 

Lemma 9 (I) p n and g n are stopping times non-increasing with respect to n £ N. 

(II) P n > Ti, Q n > t 2 and p n < Q n for all n £ N. 

(III) lim^oo p n = n and lim^^ g n = r 2 . 

(IV) As n tends to infinity, X Pn and X Qn converge to X Tl and X T2 respectively and almost surely. 

Proof. Statements (I) - (III) are obvious from the definition. We shall show statement (IV) . Consider the 
convergence of (X Pn ) ng N- Since (X t , J^t)teR+ is a non- negative supermartingale, the limit lim^oo X t (ui) 
must exist for uj £ Q. Let to £ VL with T\(ui) ~ oo. Since p n > T\, we have p„(w) = oo for all n £ N. It 
follows that X Pn {tu) = limt^=c X t (uj) — linit^oo X t (tu) for all neff. Therefore, 

lim X p (lu) = lim X t (u>) for lu £ Q with t\{uj) = oo. (36) 
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Now let u <E with T\{u) < oo. Since linin^^ p n = Ti, we have that p n (ui) < oo for sufficiently large 
n£N. This implies that X Pn (o;) = X p ( w )(w) for sufficiently large neR Since lim rwocl p n {uj) = Ti(w) 
and (-Xt)teK+ i s a right-continuous process, we have that 

lim X p (w) = X Ti / u \(oj) for cj € i7 with Ti(w) < oo. (37) 

n— >-oc n 

Making use of (|36]l. (|37]l and the definition of X Tl , we have that X Pn converges to X Tl almost surely. 
Similarly, we can show that X g converges to X T2 almost surely. 

□ 

Making use of Theorem [TJ Lemma [9] and a similar technique as that for proving Lemma [8j we can show 
the following result. 

Lemma 10 As n tends to infinity, X p ^ and X g ^ converge to X Tl and X T2 respectively in L . 

Finally, the proof of Theorem [3] can be completed by making use of Theorem [TJ Lemma [TOl and a similar 
technique as that for proving Theorem [2j 



D Proof of Theorem [4] 

First, let 7 > c and consider Pr{sup t>0 ^Q > 7}. Define t = inf{t £ [0, 00) : X t > 7}. Then, r is a 
stopping time. Define X T such that for w G fi, 



X r (u) 



Xt(u)(u) if t(u) < 00, 
c if t(oj) = 00 



Since {Xt,^t)t&L+ is a right-continuous UI martingale which converges to c, we have E|X T | < 00 and 
E[XJ = E[X ] = c. It follows that 



7Pr{r<oo}=/ 7<flP < / X T dF = E[X T ] - E [X T I {l - =oo} ] = c - E [c I {t=00 }] = cPr{r < 00}, 

J {t<oo} J {t<oo} 

which implies that Pr{r < 00} = 0. Since X t — > c < 7 almost surely, we have Pr {limsup t>0 X t > 7} = 0, 
which implies that Pr {sup t>0 X t > 7} = Pr{r < 00}. Therefore, 



Pr <^ supX t > 7 \ = for 7 > c. (38) 
U>o J 

Now let 7 < c and consider Pr {inf t > X t < 7}. Making use of (|38|) and the observation that (— X t , ^" t ) tgR +is 
a right-continuous UI martingale which converges to — c, we have that Pr |sup t>0 (— X t ) > (—7)} = for 
—7 > — c, which implies that 



t>o 



Pr <^ inf X t < 7 } = for 7 < c. (39) 



Combining (f3"5|) and (|3U)) gives Pr {X t = c for all t £ [0, 00)} = 1. This completes the proof of the theorem. 



E Proof of Theorem [5] 

Let 7 > c and consider Pr{sup t>0 X t > 7}. Define stopping time r = inf{t € [0,oo) : X t > 7}. By 
definition of X T , 

v , , UthM if t(w) < 00 
[c if t(u;) = 00 
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for w 6 fi. For simplicity of notations, let /x = E[Xo]. Since X t — > c < 7 almost surely, we have 
Pr {limsup t>0 X t > 7} = and thus Pr{sup t>0 ^t > 7} = Pr{r < 00}. Since (X t , j^t) tgK + is a right- 
continuous, non-negative super-martingale, it follows from Theorem [3] that E[X^] < E[Xo] = /x. Therefore, 

7Pr{r<oo}= / 7 dP < / X T dP = E[X T ] -E[X t I {t=oo} ] 

J{t<od} J{t<oo} 

< /x - E [X T I {T=oc} ] = (J, - E [c I {x=oo} ] = n - c(l - Pr{r < 00}). 

So, we have established the inequality 7Pr{r < 00} < /x — c (1 — Prjr < 00}). Since 7 > c, solving this 
inequality with respect to Pr{r < 00} yields Pr{r < 00} < . It follows that Pr {sup t>0 X t > 7} < 
for 7 > c, which implies that c < fi. 

Now consider Pr {sup t>0 X t > 7} under additional assumption that (X t , j?" t ) tgR+ is a continuous mar- 
tingale. Since (Xt,^t)t£M+ is a continuous martingale, we have 7Pr{r < 00} = J/ T<00 i X T dF = 
E[X T ] — E [X T I{t- =00 }] = jtx — E [X T I{t- =oc }] = /x — c(l — Pr{x < 00}) for 7 > c. Consequently, 
Pr {sup t>0 Xt > 7} = Pr{r < 00} = ^§ for 7 > c. Recalling that c < /x = E[Xo], we have that 
Pr {sup ( > X t > 7} = E[ *° ] ~ c for 7 > E[X ]. It remains to show that Pr {sup ( > X t > 7} = 1 for 7 < E[X ]. 

We claim that Pr {sup t>0 Xt > /x} = 1. In the case of c = /x, if Pr {sup t>0 X t > [jl] < 1, then there 
exists e > such that Pr{X t < /x — e for all t > 0} > 0, which contradicts to the fact that Xt — > /x = c 
almost surely. In the cases of c < /x, by the established result, Pr {sup t>0 X t > /x} = = 1. This proves 
the claim. Consequently, we have 1 > Pr {sup 4>0 X t > 7} > Pr {sup t>0 Xt > /x} = 1 for 7 < /x = E[X ]. 
This completes the proof of the theorem. 



F Proof of Corollary 0] 

By the assumption of the theorem, it can be readily shown that (Y t , J^t)t 6 R+ is a non-negative martingale. 
It follows that (lt)teK+ converges almost surely. We claim that for s £ (0, 6), lim^oo Y t = almost surely. 
To show this claim, it suffices to show that for s £ (0, 6), lim„_>. 00 Y n = almost surely, where the limit 
is taken under the constraint that n £ N. Let 7 > and s £ (0,6). For n £ N and 6 £ (0, s), we have 
E[exp(#X„)] < exp(y>(0)V n ) and by Makov inequality, 



Pr{F„ > 7} = Pr jexp(0X„) > exp ^ - [In 7 + p(s)V„] 



< 



exp(y>(0)V„) 



exp(f[hi7 + v3(s)V„] 



e/s 



exp 



y>(0) p(s) 



By the assumption that liminf„_ ! . 00 (V„+i — V n ) > 0, we have that V n > for large enough n £ N. Since 
<^(s)V„ is a convex function of s, it follows that f(s) is a convex function, which implies that — < 0. 
Since lim inf (V n +i — V n ) > 0, there exists a real number d > and an m £ N such that V n +i — V n > e? 
for all n > m. Thus, V n > V m + (n — m)d for n > m. It follows that 



^]exp 

nGN 



g(g) ¥>(«) 

s 



6»Vn 



m— 1 

< ^ exp 

n=l 

m— 1 

= E ex p 



V>(fl) ¥>(«) 
6» s 



6 s 



s 



OVn) + eX P 



0[Vm + (n - m)d] 



6>V„ + 



exp 



0v„ 



1 — exp 



< 00. 



This implies that X) neN Pr{ Y n > 7} is finite. It follows from Borcl-Cantelli lemma that Pi{r\^ =1 Uk> n [Ye > 
7]} = and thus lirrin^oo Y n — almost surely for s £ (0,6). This proves the claim that for s £ (0,6), 
lim^oo Yt = almost surely. Similarly, we can show that for s £ (— a, 0), lim^oo Y t = almost surely. 
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Since for s £ (— a, 0) U (0,6), (Yt,^t)teE.+ 1S a non-negative continuous martingale which converges to 0, 
the proof of the theorem can be completed by applying Theorem [5l 



G Proof of Theorem [6] 

Define Wt = cxp(s(X t — Xq) — ip(s)Vt) for t > and s £ (—a, b). Then, for all s E (—a,b) and arbitrary 
t' > t > 0, we have 

| &t] = E [exp(s(X t , - X ) - v(s)Vt>) | ft] = E [exp(a(X t , - X t ) - <p(a)(V t » - V*)) Wi | 
= W t eotp(-v»(fl)(V t i - V*)) E [exp(s(X t , - X t )) \ ft] < W t . 

Hence, for any s e (—a, b), (W t , .^t)teR+ i s a super-martingale with E[Wo] = E[exp(— tp(s)Vo)] < !• By 
the assumption on the continuity of the sample paths of {sX t — <p(s)Vt}t>o, we have that almost all sample 
paths of {Wt)teR+ ^ s right-continuous. 

To prove ([3]), note that for any s € (0, a) and real number 7 > 0, 



Pr i inf 

t>o 



X t - X + 7 V T + ^-^(V t - V T ) 



= Pr 
= Pr 
= Pr 
= Pr 
= Pr 



inf 



X t - X a + 7 V r 



s 

ip(-s) 



< 



s < 



inf [s(X t - X ) + <p(-s)V t + jsV T - <p(-s)V T ] < 



Sup [s(X t - Xq) - <p(s)Vt - JsVr + <p(-8)V T ] > 
t>0 



sup [s(X t - X ) - <p(-s)V t ] > lsV T - <p(-s)Vi 

t>0 



sup W t > exp (7s V T — tp(~ s)V T ) 



< exp s)V T — 7 sV r ) 
= [exp(<^(-s) - 7s)] Vt . 



(40) 
(41) 



Here, we have used the definition of Wt in (j40|) . The inequality (|4Tj) follows from the super- martingale 
inequality. This proves 

To prove (|4]), note that for any s £ (0, &) and real number 7 > 0, 

Xt-X Q -jV T -^{Vt-V T ) 
s 



Pr ^ sup 

. t>0 



Pr < sup 
I t>o 



Xt-Xo-jVr-^iVt-Vr) 



> 

s > 



= Pr <j sup [s(X t - X ) - f{s)V t - jsV T + f{s)V T ] > 
. t>o 



Pr <j sup [«(Jf t - X ) - p(s)V t ] > 1S V T - ^(s)V T 

t>0 



= Pr < sup W t > exp ( 7 sV T — ip(s)V T ) 



< exp (<p(s)V T — 7sV r ) 
= [cxp(tp(s) - 7 s)] Vt . 



(42) 
(43) 
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Here, we have used the definition of Wt in (|4"2|) . The inequality (|43|) follows from the super- martingale 
inequality. This proves (j4|). 

Before proving ([5]) and (j6)), we shall show ([9]) and (fT0|) . Note that, as a consequence of < <^(s) < 7s, 
we have tp(s)(Vt — V T ) < 7s(V T V Vt — V T ) or equivalently, <p(s)Vt + -ysV T — <p(s)V T < 7 s(V T V V*) for any 
t > 0. This inequality can be written as 

(p(s)V t + s(r) + 7 V T ) - <p(s)V T < rjs + 7 s(V T V V t ). (44) 

Hence, for any s € (0, b), 

Pr (sup [X t -X - V - 7 (V r V V t )} > 
L 00 

= Pr (sup [s(X 4 - X ) - 77s - js(V T V V t )] > 
I 00 

< Pr (sup [s(X t - X ) - V {s)V t - s(r, + 7 V T ) + <p(s)V T ] > } 
L 00 

= Pr (sup [s(X t - Xo) - <p(s)V t ] > s(r) + iV T ) - p(s)V T 
I t>o 

= Pr jsupWt > exp (s(t] + 7 V T ) - 9?(s)V T )j (46) 

<exp((^(s)V T -s(?7 + 7Vr)) (47) 
= e~'' s [exp (<^(s) — 7«)] Vt • 

Here, (|45]) follows from (|44"]) . We have used the definition of Wt in (|46|) . Recall that, for any s <G (—a, b), 
(Wt, J^t)t 6 K+ is a supcr-martingalc with E[Wo] < 1. The inequality (J4TJ) follows from the super-martingale 
inequality. This proves (|T0|) . The proof of ((9]) is similar. 

Now we are in position to prove ([5]) and ((6|). In the case that {s e (0, b) : tp(s) < 7s} is empty, ((6]) is 
clearly true, since the infimum is no less than 1. In the case that {s £ (0, b) : tp(s) < 7s} is not empty, it 
follows from (jTU)) that 

Pr (sup [X t - Xo - 7(V T Wt)] > ol < inf [exp (<p(s) - 7 s)] Vt = inf [exp (ip(s) - 7 s)] Vt . 

[t>0 J {se(0,i)):¥>(s)<7s} s£(0,b) 

This proves ([6]). The proof of (0 is similar. 
To prove ([7]), note that, for any s e jz/, 

Pr (inf [X t -X Q + V + 7 V t ] < 0} = Pr (sup [(-s)(X t - X ) - 7 ? s - 7 sV t ] > 



00 



t>0 



< Pr <^ sup [(s)(X t - X ) - tp(-a)V t ] >sr]}=Pvi sup W t > exp(s?7) } < exp(-sr ? ), 
L *>o J L *>o J 

where Wt = exp [(— s)(X t — Xo) — <p{— s)Vt] and the last inequality follows from the super-martingale 
inequality. 

To prove ([8]), note that, for any sef, 



Pr i sup [X t -X -r)- 7 V t ] > \ = Pr i sup [s(X t - X ) - - 7 sV t ] > 
Loo J L*>o 



< Pr < sup [s(X t — X ) — <^(s)Vt] > srj > — Pr < sup W t > exp(s^) > < cxp(— sr]), 
Loo J Loo J 

where Wt = exp [s(X t — Xo) — ip(s)Vt] and the last inequality follows from the super-martingale inequality. 
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Wc shall show statement (I). For simplicity of notation, define g(s) — ip(s) — 7s for s £ (0,6). To 
show (|12[) . recall the assumption that ip{s) is a non-negative, continuous function smaller than 7|s| at a 
neighborhood of 0. Hence, there exists a number e £ (0,6) such that ip(s) < 7s for s £ (0, e]. Since 
g(e) < = ,g(0), it must be true that either the infimum of g(s) is attained at some s* £ (0,6) or 
inf sg ( 0j& ) g(s) = lim s -t-b g(s) < g(e) < 0. In the former case, (IT21) of statement (I) is true as a consequence of 
((3]). In the latter case, we can define ip(b) = lim^f, ip(s). Then, 61im s |b = <fi(b) < 76 and ip(b) — 76 = 
inf se (o,6) [f{ s ) — is]. Consider W t = exp(b(X t — X ) — ip(b)Vt) f° r t >Q. For arbitrary t' > t > 0, making 
use of Fatou's lemma, we have 



[exp(6(X t , -X*)) |^i] 



liminf exp(s(X t , - X t )) | &t 



< liminf E [exp(s(X t / - X t )) I J^t] 



< liminf exp(v9(s)(Vi, - Vt)) = exp(>(&)(V t , - Vt)) 



and consequently, 

E[Wf I ^t] = E [exp(6(X t , - X ) - <o(&)V t | = E [exp(6(X t , - X) - p(6)(V t » - Vt)) Wt \ 
= Wt exp(-tp(b)(V t > - Vt)) E [exp(&(X t , - X t )) \ ,9t\ < Wt 

almost surely. This implies that (W t ,^t)tm+ 1S a super-martingale with E[Wo] = E[exp(— ip(b)Vo)] < 1. 
So, for any real number 7 > 0, 

Xt-Xo- 7 V T - Urn ^ (V t - V r ) 



Pr ^ sup 

. t>o 



> 
6 > 

= Pr I sup [b(X t - X ) - tp(b)V t - ibV T + <p{b)V r ] > 
t>o 



Pr ^ sup 

. t>o 



x t -x - 7 v T - lim ^ (Vt - v T ; 

sfb s 



= Pr sup [b(X t - X ) - <p(b)V t ] > lbV T - V {b)V T 

L i>0 

= Pr { sup W t > exp ( 7 6V T - <p(b)V T ) \ < [cxp (ip(b) - 76)] Vt = inf [cxp (<p(s) - js)] Vt . 
[t>o J se(o,b) 

This establishes (fT2|) . Now we shall show that < ,8(7) < 7. Clearly, (8(7) is positive. In the case that 

the infimum of g(s) is attained at some s* £ (0, 6), we have g(s*) < g(e) < 0, which implies that ,8(7) < 7. 

In the case that inf s£ (o,&) g(s) = lim s -|-& g(s) < 0, we have lim3T ^ v ^ = lim s -|-& ^2 < 7. So, in both cases, 

< 0(7) < 7- 

In a similar manner, we can show (jlip and the inequality < 0(7) < 7. 

Finally, we need to show statement (II). This is clearly true for the case that lim s -|-& "£l < j, it suffices 
to consider the case that lim s -r& > 7. In this case, by the assumption that is monotonically 
increasing with respect to \s\ > 0, there exists a unique number 6* £ (0, 6) such that - = 7. Therefore, 
inf/ se (o,6) :v ,( s )< 7S } exp (y(s) — 7s) = mf se (o,6»] exp (y(s) — 7 s )- It follows from ([TO]) that (fT4| is true. In a 
similar manner, we can show (|13[) . This concludes the proof of the theorem. 

H An Upper Bound for the Moment Generating Function of a 
Uniform Random Variable 



In this appendix, we shall establish the following result. 

Theorem 8 Let Y be a random variable uniformly distributed over [—5, |]- Then, E[exp(sY")] < exp ( f-j 
for any s £ K. 77ia£ is, i/ie moment generating function of Y is bounded from above by cxp ^§4^ ■ 
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(e 3 -l)e~3 



We want to show 



Proof. Note that the moment generating function of Y is E[cxp(sY~)] 
that g(s) < exp for any set. Define h(s) = s E[exp(sF)] - exp (j^j . Then, h(s) = (e s - l)e~ 

sexp ^fj^ • It can b e checked that the derivative of h(s) is h'(s) = u(s) — v(s), where 



«(*) = o (e 5 + e i), v(s) = ( 1 + — ) exp ( — 
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Using Taylor series expansion formula, we can write 



4*(2i)! 



v(s) = l + J2 



(*)' 




i— 1 

I ^ 




, (24, 


/ 12 




(i 


-1)! 



l ^ l + 2i 2i 



i=l 



24* i! 



Since ft-'(O) = u(0) — i>(0), to show the theorem, it suffices to show that u(s) < v(s). This can be 



accomplished by proving 



< 



4 i (2i)l ^ 24 ; t! 



for 



1, 2, • • • , or equivalently, 



_L < 1 + 2i 



(2i) 



1,2,... 



To do so, define the ratio of i±|^ to as f(i). It can be checked that f(i) = ^jj^r^ for i = 1, 2, ■ ■ ■ . 
Since /(l) > 1 and = 1 + f > 1 for k > 1, we have /(i) > 1 for all i > 1. This implies that 

u(s) < v(s) for s£i The proof of the theorem is thus completed. 

□ 



I Proof of Corollary [5] 

Let ?/>(.) be the inverse function of u(.) such that u(ip(Q) = ( for ( g {^(0) : G 0}. Define = v(ip(£)) 
for C e {u(0) : 9 e Q}. Putting ( = u(9), we have E [exp(sY)] = exp(/i(C + s) - h(()). Define <p(s) = 
h(C + s) - h(C) - 6s and 

Z n = X n - nd, V„ = n 
for n £ N. For n € N, let denote the cr-algebra generated by X\, ■ ■ ■ , X n . Then, 

E[exp(s(Z„ - Z m )) | & m ] = exp((V„ - V m >(s)) 

for to, n € N with to < 72. Assume that 6 + 766. Noting that 

we have 

%(*) - 7*] = d/^) _ (g + 7) = + s) _ (g + 7) , 

as as 

Define s* = ^(# + 7) — it(6'). Invoking the definition that £ = we have C + s* = u (0 + 7), which implies 
that V(C + s*) = 9 + 7. Therefore, 



d[(p(s) - 7 s] 



^(C + s*)-(0 + 7 ) = O. 



s=s* 

Since </c(s) — 7s is a convex function of s, the infimum of (p(s) — 7s is attained at s = s*. Note that 
p(a*) = h(C + u (fl + 7) - u (0)) - /i(C) - 0[u(0 + 7) - u(0)] = u(0 + 7) - - 0[u(0 + 7) - «(#)]• 
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Thus. 



- 7s* = v{6 + 7) - w(0) + (0 + 7)[u(fl) - u{9 + 7)], 
<p(s*) _ w(0 + 7) - v{6) 



s* u(9 + j)-u(9) 
Applying Theorem^ we have 

Pr \ sup [X n - n6 - 7(71 V m)] > I < Pr i sup 



6(0,7)- 



(49) 
(50) 



X „ ~ n6 — mj — - (n — m) 



> Oj < exp(m[ip(s*) — 7s*]). 



(51) 

Making use of (gHJ), ([5T|) and the definitions of p and we have that Pr{sup Il>0 [X„— n9— 7(71 Vto)] > 
0} < Pr{sup„ >0 [X n - p{6 + 7, 0, m, n)] > 0} < [Jj((9 + 7, 9)) m provided that 6 + 7 £ 9. This proves (fig]). 
Now we shall show (jTHJ) . Assume that — 7 G 0. By virtue of (|48p . we have 



d[tp(— s) — 7s] dh(Q — s) 



ds 



ds 



+ (0- 7 ) = -V,(C-s) + (0- 7 ). 



Define s* = u(9) — u(9 — 7). Invoking the definition that Q = u(9), we have £ — s* = u(9 — 7), which implies 
that i/j(C — s *) = — J- Therefore, 



d[<p(-s) - 7s 



7-^(C-**)=0- 



Since s) — 7s is a convex function of s, the infimum of </?(— s) — 7s is attained at s = s*. Note that 
tp{-a*) = h(( - u{6) + u{9 - 7)) - h(Q + 0[u(0) - u(9 - 7)] = v(9 - 7) - v{9) + 6[u{6) - u{6 - 7)]. 
Thus, 



(f(-s*) - 7s* = v(9 - 7) - v(9) + {6- j)[u{9) - u(9 - 7)], 
<p(-s*) _ v(9-^)-v(9) 



s* 



u(9) - 14(0-7) 
Applying Theorem [51 we have 

Pr { inf [X„ - n6 + 7(71 V m)] < i < Pr { inf 



G (0,7) 



X n - + 7717 + ^ S - (n - m) 



(52) 
(53) 



< f < exp(?n[<,o(— s*) — 7s*]). 

(54) 



Making use of (|52]l. ([53]) . (|54| and the definitions of p and we have that Pr{mf n> o[A„ — ?i0+7(nVm)] < 
0} < Pr{inf, i>0 [A„ - p(6 - 7, 0, to, n)\ < 0} < [^(0 - 7, 6)] m provided that - 7 G 9. This proves (Hi 
The proof of the theorem is thus completed. 



J Proof of Corollary [6] 

For simplicity of notations, define A t T = Y T — X T — s/V t — V T and B t T = Y T — X T + s/Vt — V T + 5, where 
S is a positive number introduced for the purpose of ensuring Bt, T — At. T > 0. By the assumption that 
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\X t — Y T \ 2 < Vt — V T , we have that A t . T < X t — X T < B tT almost surely. For t > r > 0, we have 



E e 



,a{X t -X T ) | ^ 



■9 T \ < E 



B t , T - [X t - X T ) ^ aAt T (X t - X T ) - At,r c sB t , T i g. 



Bt, T — At, T B tyT — A ttT 

Bt,T e aAt ^ - At, T e aBt ^ e aBt ^ - e aA 



Bt.r — At.r Bt, T — At.T 

B t ,T e aAt ^ -At.T e aBt -r 



E [X t - X T I & r ] 



< exp 



= exp 



B t , T — A t .T 
s 2 (Bt,T-At, T ) 2 



s 2 (VVt-V T + ^Y 



(55) 
(56) 
(57) 
(58) 
(59) 



almost surely, where (|55|) follows from the convexity of the exponential function, ([55]) follows from the 
fact that At, T and B ttT are measurable in J£" T , ([57|) follows from the assumption that {X t , ^ r t )teR+ is a 
super-martingale, (|58| follows from the inequality ye x — xe y < (y — x) exp(\y — x\ 2 /8) for y > x. Since <(59j) 
holds almost surely for any S > 0, it must be true that for any s€l, 



E 



s(X t -X T ) I 



< limexp 

5^0 



exp 



(V t - V T )s< 



almost surely. Therefore, we have shown that E [e s( - At Xt ^ \ J£" T ] < cxp((Vf — V T )ip(s)) with (p(s) = 4j-. 
Clearly, ip(0) = and f(s) is convex. Moreover, for e > 0, inf se ( .oo) lr°( s ) ~ es ] i s attained at ,s = s* with 
s* = e. It can be checked that <p(s*) — es* = — 4r- and v ^ 8 , = §■ Hence, applying Theorem [SJ we have 



Pr <^ sup Xt-X - eV T - - (V t - V T ) 



> } < exp - 



e 2 V T 



Substituting 7 in the above inequality with eV T yields (|17[) . In a similar manner, we can show (fT8 
To show (Uni), note that 



sup 

t>o 



2 V Vt 



x t - x + - (1 + — 

2 I V T 



< 



C ^ sup 

. t>0 



l^-^o|-|(l + ^ 



< 



Making use of this observation, Bonferroni's inequality, inequalities (|17p and (|18[) . we have 

, 2 



Pr •{ sup 



i*-*bi-2(i+£ 



< (U > 1 - 2 exp 



7 



2V T J ' 



from which (fTi?)) immediately follows. This completes the proof of the theorem. 



K Proof of Corollary [7] 



Define g(s) = 5Z^_ 2 ■ Then, g(s) = e s l s for s ^ and g(0) = i. It can be shown that g(s) is 
increasing with respect to s. It is well known that g(s) < 2 (i- s /3) ^ or s e (®> 
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K.l Proof of (J20D 

Making use of the assumptions of the theorem and following the techniques of [3J [5] , we have that 



E \ e s(X n -X n _^a n ) j jj. , =E 



y ] vy {X n — X n -i — a n ) k | J? n -1 



1 — sa n + E 



_fc=2 

< 1 - sa n + s 2 g(sb) (a 2 . + a 2 ) < exp (-sa n + s 2 g(sb) (a 2 + a 2 n )) 
almost surely. This implies that 



< 1 - sa n + s 2 g(sb) E \(X n - I„_! - a n ) 2 | J?„_i] 



1 - sa n + s 2 g{sb) (E [(X n - E[X n \ J^]) 2 | ^ n _i] + a*) = 1 - sa„ + s 2 < 7 (s6) [Var(X n | J^) + a 2 n ] 

2 / .x / 2 , 2i 



I ^n-i] < exp (s 2 g(s6)(V„ - V„_i)) = exp 



(e sb -1-sb) 



(V n - V„-i) (60) 



almost surely. Thus, we have that EJe 3 ^™ - ^™- 1 "' | & n -i] < exp((V„ — V n _i)y>(s)) almost surely, where 
tfi(s) = - — ~bl~ sb - Now consider (X n ) ne ^ in the context of Theorem[6l Clearly, ip(0) = <p'(0) = and tp(s) 

By differentiation, it can be shown that inf sg ( 0jO o) [ ( / 3 ( s ) — 7 s ] 1S attained at 

iW - f Therefore, 



* _ infi+67) 



is convex. Let s 

s = s*. It can be checked that <p{s*) - 7s* = £ - a±MMl±^r) an d 
applying Theorem [SJ we have 



ln(l+b 7 ) 



Pr < sup 

[n>0 



X n — A'o — 7V,, 



7 



ln(l + 67) b 



(Vn ~ V m ) 



> )■ < 



exp 



7 (1 + 67) ln(l + 67) 



This completes the proof of (|2TJ1) . 

K.2 Proof of (jUD 

Since g(s) < 2 (i- s /s) ' follows from (pOj) that 

E [ e «(jr B -x„_0 j t ^ n _ 1 ] < exp ( s 2 g ( s 5)( Vn _ Vn _ 1 )) < exp 



2(1 -bs/3) 



(V„ - V„_ x ) 



almost surely for s e (0, |). This implies that for s G (0, f ), E[e s( - Xn ~ x ™-^ \ & n -i) < exp (<p(s)(V n - V„_i)) 
almost surely, where (p(s) = 2 ii-bs/3) ■ Applying inequality ((4]) of Theorem [6] with s = xT¥ leads to in- 
equality (j2Tj) . 



K.3 Proof of (122 



Applying inequality (|60|) with at = and 6=1, we have that 

E [ e .(Jc n -jc B _0 j $r n _^ = E [ eS (x B -jr B _ I )] < cxp((eS _ ! _ fl j^) < CX p( s 2 ( j2) 

almost surely for s £ (0, |]. Here, we used the fact that e s — 1 — s < s 2 for s e (0, |]. To see this, consider 
function f(s) = f e s — 1 - s — s 2 . Note that f'(s) — e s - 1 - 2s and f"(s) — e s — 2. Clearly, /'(s) decreases 
from to its minimum at s = In 2 and then increases for s € (In 2, 00). Since /'(0) = 0, there exists a 
positive number p > such that /'(s) is negative for s € (0, p) and positive for s € (/?, 00). Since /(0) = 0, 
it must be true that /(s) decreases from to its minimum as s increases from to p and then increases 
for s £ (p, 00). It follows that if f(t) < for some t > 0, then f(s) < for all s S (0, t). It can be checked 
that /(|) < 0, thus, we have /(s) < for all s <G (0, \}. 
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So, we have shown that for s G (0, X], E[e s ^ Xn Xn -^ | J^ n _i] < cxp ((V„ — V n -i)<p(s)) almost surely, 



where ip(s) = s 2 . Consider (X„)„ e N in the context of Thcorcm|6] Let e > 0. Note that 



dip(s) 
ds 



e if s 



Accordingly, (3(e) = § and s(/3(e) — e) 



Thus, applying Theorem |6l we have 



Pr ■{ sup 

k n>0 



X n — X$ — eV m — ~ ^ m ) 



> } < cxp [ -- 



for e < |. Letting eV m = 7 in the above inequality leads to (f2"2")l . This completes the proof of the corollary. 



L Proof of Corollary [8] 

Define Y t = X t - \t for teR+. Let V t = t for i G M+ and let p(s) = A(e s — 1 — s) for s G R. Consider the 
process (lt)teK+ m the context of Theorem |B1 Clearly, (Yt)t S R+ is actually a right-continuous stochastic 
process such that E[exp(s(Y t < — Y t )) \ < exp((Ve — Vt)f(s)) almost surely for arbitrary t' > t > 
and s G (—00,00). Since the derivative of ip(s) — 7s with respective to s is Ae s — A — 7, it follows that 
inf sg (o ]0 o)[v(s) — 7 s ] is attained at s* = ln-r^. Consequently, 



inf [y>(s) - 7s] = y>(s*) - 7 s * = 7 - (A + 7) In — : — and 18(7) = — — 
s6(0,oo) A s* 



A. 



Applying Theorem [6] gives 

Pr < sup Yt — jt 

t>o 



A (t-r) 



> ^ < 



cxp 7 — (A + 7) In 



A + 7 



which implies that Pr{sup t>0 [X t — (A + 7)r 



7(t-r) 



> 0} < [(^) A+7 e 7 ] T for any r > and 7 > 0. 



On the other hand, since the derivative of <p{— s) — 7s with respective to s is — Ae s + A — 7, it follows 
that inf s e(o,oo)[v( — s ) — 7 s ] is attained at s* = ln-^— . Consequently, 

A — 7 (p( — s*) 7 

inf J^(- s ) - 7s] = -7 - (A - 7) In — r— and a{y) = ; — = A _ + A. 

se(o,oo) A s* ln^-^ 



Applying Theorem [6] yields 

Yt+JT 



Pr <^ inf 



In 



b7 + A (t-r) 



< (U < 



exp I —7 — (A — 7) In 



A-7 



which implies that Pr{inf t>0 [X t — (A — 7 )r + jffljj < 0} < [( x ^ 7 ) A_7 e" 7 ] T for any r > and 7 > 0. This 
completes the proof of the corollary. 
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